One-shot Slepian-Wolf 



Naresh Sharma' EI and Naqueeb Ahmad Warsi^'0 

'School of Technology and Computer Science, 
Tata Institute of Fundamental Research (TIFR), Mumbai 400 005, India 
(Dated: Januarys, 2012) 

Slepian and Wolf gave the rate-region for the distributed encoding of correlated and memoryless 
sources when the number of copies of source output is unlimited. We give one-shot rate region 
. . . for the Slepian-Wolf protocol when a single copy of the source output is available. Our results 

(N ■ are asymptotically optimal, i.e., they yield the same rate region as the Slepian-Wolf in the limit of 

, unlimited copies. We also give an upper bound for the one-shot encoding of a single source that is 

' different from the one given by Renner and Wolf. 

'sf ; I. INTRODUCTION 

E~| ' Over the last several decades, information theory has been used to analyze the performance of various in- 

^ formation processing tasks such as data compression, information transmission across a noisy communication 

Q I channel etc. The analysis has traditionally been asymptotic wherein a certain task is repeated unlimited num- 

ber of times. Such an approach has yielded rich dividends providing fundamental limits to the performance 
and gave operational meaning to quantities such as entropy and mutual information m. 
^ i But the assumption of repeating an information processing task is hardly realistic. There has been a great 

I interest over the last few years to analyze a task done only once. Typically, the analysis involves finding lower 

' and upper bounds on the resources needed to perform such a task. This has been referred to as "one-shot" or 

"single-shot" in the literature. 

^ I The lower and upper bounds are expected to be asymptotically tight, i.e., they both yield the same average 

number of resources needed per task when the number of times a task is performed is unbounded and this 
quantity is also equal to the asymptotic analysis that has been done traditionally. It is interesting to note 
that while the asymptotic analysis would start with the asymptotic equipartition property (AEP), the one- 
shot analysis could, at the very end, be augmented with AEP to yield the same answer. Furthermore, one- 
shot analysis has been applied to the cases where i.i.d. (independent and identically distributed) and the 
5^ I memoryless assumption is not valid. For example, in a data compression task, we may not have i.i.d. copies 

of the random variable modeling the source output or in a communication across a noisy channel, the channel 
may not be memoryless. 

The one-shot bounds are typically in terms of smooth Renyi entropies (defined later). The elegant notion 
of smooth Renyi entropies were introduced by Renner and Wolf in Refs. where they also gave one-shot 
bounds for data compression and randomness extraction (see also Ref. iB]). Another important application of 
smooth Renyi entropy measure has been the one-shot bounds for the channel capacity given by Renner, Wolf 
and Wullschleger Channel coding bounds are also derived in Ref. |01 using a quantity called the smooth 
0-divergence, which is a generalization of Renyi's divergence of order 0. 
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The smooth Renyi entropies were extended to the quantum case by Renner and Konig 181]. There has been 
a considerable work on the one-shot bounds for the quantum case under various scenarios (see for example 

Refs. Jiliii and references therein). 



In Ref. il5\\ . Schoenmaker et al introduce the notion of smooth Renyi entropy for the case of stationary 



ergodic information sources, thereby generalizing previous work which concentrated mainly on i.i.d. infor- 



mation sources. In Ref. lllq] . Holenstein and Renner give explicit and tight bounds on the smooth entropies 



of n-fold product distributions in terms of the Shannon entropy of a single distribution. Renes and Renner 



consider the problem of classical data compression in the presence of quantum side information in Ref. lllTl] . 

It is worth noting that for the classical case, to the best of authors' knowledge, there is no one-shot result in 
multi-party scenario, i.e., where there are multiple parties at the sender and/or receiver. Let us concentrate on 
the distributed encoding (data compression) protocol of correlated information sources. In a very remarkable 
and fundamental paper, Slepian and Wolf showed that there is no loss in the compression efficiency for the 



distributed encoding as compared to the collaborative encoding IllSn . 

The fundamental contributions by Renner and Wolf AH] have not been extended thus far to the Slepian- 
Wolf distributed data compression protocol. The upper bound that Renner and Wolf derive for their data 
compression comes in the form of two steps. One is the encoding (that can be accomplished by two-universal 
hash functions) and second is an elegant step of bootstrapping the first step by encoding a random variable that 
is in a ball (appropriately defined) around the random variable that we want to compress. Such an approach 
distributes the eiTor in the two steps in a flexible way and yields an upper bound that is asymptotically tight. 
To carry over this approach to the Slepian- Wolf protocol would involve proving the existence of more than 
one random variables that satisfy certain conditions and the authors know of no such proof in the literature. 

In this paper, we let go of the second step and define a set for the one-shot case reminiscent (though not the 
same) of the typical set in the asymptotic case. We don't demarcate the lines between the various steps and 
our encoding (based on two-universal hash functions) together with this set come together to yield a one-shot 
characterization of the Slepian-Wolf protocol. Interestingly, our bounds involves smooth Renyi entropy of 
the order — oo. Renyi entropies are typically defined of order a > and appropriate limits have to be taken 
for a = 1 that corresponds to the Shannon entropy I19I1 . In the definition of smooth Renyi entropy, we let 
a G [—00, 00]. 



II. PRIOR ONE-SHOT RESULTS ON DATA COMPRESSION 

We first give the definitions of the smooth entropies that are needed for the one-shot bounds. 



A. Definition of various entropies 

We shall assume that all random variables in this paper are discrete and take values over a finite set. Let 
X be a random variable taking values over alphabet X with probability mass function (PMF) Px{x), x ^ X. 
Then the Shannon entropy of X is defined by 



H{X) ■.= -Y,Px{.x)\og[Px{x)l 



(1) 



where we shall assume that the log is to the base 2 throughout this paper. The Renyi entropy (l^ of X is 
defined as 



HaiX) :-- 



1 



1 — a 



log 



.x&X 



(2) 



where a G [0, oo] and appropriate limits are taken for a = 1. In particular, for q = 0, the Renyi entropy is 
given by 



H^{X) ■.= \og\{x(^X ■.Px{x)>{)}\ 
and for a = oo, the Renyi entropy is given by 



H^{X) :=-log 



maxPxC^;) 



(3) 



(4) 



Let X, Y be two random variables with joint distribution Pxy, the conditional Renyi entropy of order a is 
defined as 



H^{X\Y) :-- 



1 



log 



y&y ~z, ' 



1 — a 

The e-smooth conditional Renyi entropy of order a ||3|] is defined for e > as 

1 



(5) 



1 — a 



log 



inf max > P%\v_ ix) 

XY:Pr[XYytXY]<e y&y ^ X\^-y 



(6) 



Although the Renyi entropy is typically defined for a € [0, oo], we let a G [— oo, oo] and, in particular, 
consider the Renyi entropy of order a = — oo given by 



H^ooiX\Y) := - log 



min min Px\Y=vi^) 
yey x:PxiY^y{^)>0 



(V) 



and its smooth version for e > as 



Hi^{X\Y) :=-log 



sup min min Pjfiy (x) 

XY:Pr[XY^XY]<ey^y ^■Px\Y=yi^)>0 



(8) 



We shall use H^{X) interchangeably with H^{Px] 



B. Prior results 



Let {X, Y) be two random variables taking values over alphabet ^ x 3^ with joint distribution Pxy- We 
shall denote this by {X, Y) --^ Pxy- X is available with Alice at location A and she wants to send it to 
Charlie at location C who has an en^or-free copy of Y. Alice encodes X and sends it over a noiseless channel 
to Chaiiie who decodes it. Our goal is to construct a protocol to minimize the number of distinct encoder 
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outputs while keeping the probability of the decoder output being in error (or not equal to the encoder input) 
to be within some predefined limits. 

To accomplish this, Renner and Wolf came up with the following protocol iil]. Alice applies a random 
function (encoder) to X and then sends it to Charlie who has the knowledge of the random function used by 
the encoder and applies a function depending on the encoder and Y. If the probability of error averaged over 
all random functions is small, then there must exist at least one pair of functions (or the encoder/decoder pair) 
which shall accomplish our task. This is stated formally as follows. 

Definition 1 (Renner and Wolf |H). For {X, Y) ~ Pxy and the error e, < e < 1, let K^{X C) denote 
the set (e, R) where R is a random variable with range TZ, e : X x TZ ^ C such that there exists a decoding 
function g: CxyxTZ—^X with 

Pv[x{R)^x} <e, (9) 

where 

X{R):=g[e{X,R),Y,R]. (10) 
The definition for the minimum encoding length is given by 

il^,{X\Y):= min logjC|. (11) 

C-3(e,R)&KP{X^C) 

(12) 

Theorem 1. (Renner and Wolf^) Let {X, Y) ~ Pxy and e, Eq and E\ S M"*" with eq -\- £\ < e, then 

Hl{X\Y) < il,,,{X\Y) < H',HX\Y) - log(e2). (13) 



III. DISTRIBUTED ENCODING OF CORRELATED SOURCES 

We describe the task of distributed encoding of correlated sources in this section. 

Let {X, Y) ~ Pxy- Assume that the random variable X is available with Alice at a location A and the 
random variable Y is available with Bob at a separate location B. Both Alice and Bob want to get across the 
pair {X, Y) to Charlie at location C without collaborating with each other within some prescribed enm We 
state this formally as follows. 

Definition 2. For the error e, < e < I, let A^{JY x y ^ Cx x Cy) denote the set {ex, ey, R) where R is 
a random variable with range TZ, ex X xTZ ^ Cx and ey : y xTZ ^ Cy such that there exists a decoding 
function g : Cx x Cy x TZ ^ A! x y with 

Ft[{X{R),Y{R))^{X,Y)} <E, (14) 

where 



{X {R),YiR)):=g [ex (X, R) , ey (Y, R) , R] 



(15) 
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Occasionally, we shall also use the following 



gx [ex{X, R), ey{Y, R), R] := (16) 
gy[ex{X,R),ey{Y,R),R] ■.= Y{R). (17) 



The definitions for the minimum encoding lengths are given by 



^d-onc(^) ■■= min logical, (18) 

^d-cnc(^):=, ^, min^^ ^ logical, (19) 

where we have written for h.^ {X ^ y Cx ><■ Cy). 

IV. MAIN RESULTS 

In this section, we summarize the results and the proofs are given in the next section. 
We first need the following definition. 

Definition 3. For {X, Y) ~ PxY, we define the following sets 

MPx) := {x : ^Ln{Px) < -logPxix) < hLx(^x)}, (20) 

where 

Ei,,,iPx) := HiX) - \HiX) - Hi{X)\ - Jlog (21) 
Smax(^x) := H(X) + \H{X) - Ht^{X)\ + 51og (22) 

AsiPy) := {y : H^i„(Py) < -logPy(y) < ^L.{Py), (23) 
As{Pxy) ■■= {ix,y) : ^LrriPxY) < -\ogPxY{x,y) < Ei^^iPxY), 

x€A5{Px),y^As{PY)}. (24) 

Our first result is to give an upper bound different from the one in Theorem [T] and we don't change the 
lower bound but it is mentioned for completeness. 

Theorem 2. Let {X, Y) Pxy cind e, eo, ei G IR^ with Sq + ei < e, then 

H'oiX\Y) < il^,{X\Y) < HLx(Pxy) - ^LniPY) - log^i, (25) 
where J > is chosen such that 



Pt{X ^AsiPx)} <eo. (26) 
We give the one-shot bounds for the distributed encoding for correlated sources in the following theorem. 
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Theorem 3. Let {X, Y) ~ Pxy and e, E M+, i = 0, 1, 2, 3 with J^Uo ^ ^■ 

Lower bounds; For any distributed encoding protocol, the following lower bounds shall hold 

ll_,^,{X)>Hl{X\Y), (27) 
l'^_,,,{Y)>H^,{Y\X) (28) 

Achievability; There exists a distributed encoding protocol for a rate pair 



^d-enc 



(X), ^|_^j^^(y)) satisfying the following conditions 



4-enc(^) > ^LAPxy) - ^LniPy) " logEl, (30) 
^d-enc(^) > ^LAPxy) - ^LniPx) " loge2, (31) 
^d-encW+^d-enc(^) >Smax(^Xy)-loge3, (32) 

where 6 is chosen such that 

FT{{X,Y)(^AsiPxY)}<eo. (33) 

Next we show that the one-shot bounds given in Theorem |2] and one-shot rate region in Theorem |3] are 
asymptotically optimal, i.e., both the lower bounds and the achievable rates (normalized appropriately) are 
the same when the number of i.i.d. copies of {X, Y) pairs grows unbounded and the eiTors become ai^bitrarily 
small, and that this rate region in the distributed encoding case comes out to be the same as that of Slepian- 
Wolf H- Let 

(X^,Y^) := [{Xi,Yi),{X2,Y2),...,{Xn,Yn)], (34) 
where {Xi, Yi), y„) are n i.i.d. pairs of random variables distributed according to Pxy- 

Lemma 1. The normalized asymptotic limit of (1251 ) is given by 



lim lim = H{Xi\Yi). (35) 

e— i>On— >oo n 



Similarly, we can get the asymptotic limit for Theorem [3] which yields the rate-region of Slepian-Wolf 



m. 

Lemma 2. TJie normalized asymptotic limits for the bounds in Theorem\3\are given by 



lim lim '^-""'^^ ^' > H{Xi\Yi), (36) 

£->0n->-oo n 

lim lim > H{Yi\Xi), (37) 

e— 5.0 n— >oo n 



lim lim 

£— >0 n— >-oo 



^d-enc(^l ) + ^d-cncC^l ) 



n 



>H{Xi,Yi). (38) 



V. PROOFS OF THE RESULTS 
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Some of the proofs rely upon the two-universal hash functions and we give their definition first (see also 
Ref. 1 I20I ] and references therein). 

Definition 4. A random function f : X x TZ ^ C takes an input x ^ X and generates a uniform random 
variable R taking values over alphabet TZ and outputs c ^ C. f is called a two-universal hash function if for 
any x ^ x, x,x & X, we have 

Pr{/(x,i?) = /(f,i?)} < (39) 

We prove the following lemma that shall be needed for the probabihty of error analysis later. 
Lemma 3. Let {X, Y) ~ Pxy- Define 

MPx\Y=y) ■■= {x ■■ (x, y) € AsiPxv)}- (40) 
For any 6 > 0, y & As{Py), we have 

\As{Px\Y=y)\ < 2^--(-f'^y)-=min(-Py). (41) 
Proof. For any {x, y) G As{X, Y), we have 

P^,y(x) = E]^X^ > 2-=fnax(Pxr) + Sf_(Pv). (42) 

The lemma now follows straightforwardly from 

1 > Px\Y=y{x) > \As{X\Y = y)i2~^L..iPxY)+Ei,^,iPY)^ (43) 

x(^As{X\Y=y) 

where we have used (l42l l. □ 

The following properties of Hf^^ are needed later in the paper. 
Lemma 4. The following holds for any e > 

Ht^{X)>H',{X). (44) 
Proof. For all 5 > 0, there exists a random variable X with Pr{X 7^ X} < e such that 

Ht^{X)>H^UX)-6. (45) 

Now the following inequalities hold 

Ht^{X) > H^ooiX) - 6 (46) 

> Ho{X) - 6 (47) 

> H'oiX) - 5. (48) 

Since this is true for any 6 > 0, the result follows. □ 
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Lemma 5. If X'l = \Xi, X„] be n i.i.d. random variables distributed according to Px, then 



lim lim ^-ooi^i) = H{Xi] 

£->-0n— >oo n 



(49) 



Proof. The typical set, 7^^"^ C e > (see Ref. 10] for details) is defined 

1 



as 



We now define a random variable Z as 



n 



< £ 



z 



if Xf G 



(n) 



where W is uniformly chosen at random from the set Te^^ ■ We now have 

Pr {z / = vy{xi ^ 



(50) 



(51) 



(52) 
(53) 



where we have assumed that n is large enough so that ( [53l ) is satisfied. To get a bound on min^ Pr{Z = z], 
we note that for w G 7^^"^ Pr{Xi" = lu} > 2""(^(^i)+^). Now using the definition of Ht^{X) and 
Pr{Z / } < £, we have i?i^(Xf ) < H^^{Z), and hence, 



n 



n 



or 



lim lim < 

e— >-0n->oo 77, 

We now use LemmaHto get H^_^{Xi) > H^{Xi) and hence, 

lim lim E:22^ > lim ^^^^ = H{X,] 



(54) 



(55) 



(56) 



where the equality in (1561 ) follows from Ref. [4]. Thus, from (1551) and (I56b . the lemma is proved 



□ 



A. Proof of upper bound in Theorem |2] 

We show the existence of a communication protocol based on two-universal hash functions and is given 
by the following steps. 

1. Let e : X X TZ ^ C be a. two-universal hash function and let C = {1, 2, • • • , 2^}. Alice takes x £ X, 
generates R (known to Charlie), and sends i = ex{x, R) to Charlie. 

2. Charlie passes the received index i to the decoder g: CxyxlZ^X that outputs x = x if there is 
only one x such that e(x, R) = i and (x, Y) € As{Pxy)- In all other cases, it declai-es an eiTor. 



Let eo,ei € and Eq + Si < e. The probability of error of the above protocol is computed by defining 
the following events. 

Eo:={{X,Y)iAs{PxY)}, (57) 
Ei:={3x^X : e{x, R) = e{X, R), (x, Y) € As{Pxy)}- (58) 

The probability of error is given by the probability of the union of these events and we upper bound that by 
the union bound as 

= Pr{EoU^i} (59) 
<Pr{Eo} + Pr{Ei}. (60) 

We could choose a 5 > s.t. Pr{£'o} < eo- Such a choice of S clearly exists since by choosing 6 = 0, 
Pic{Eq} = 0. We now bound Pr{£^i} as follows. 

Pv{Ei} = Pr{3 x^X: e(x, R) = e{X, R), {x, Y) € As{Pxy)} (61) 

= Y,PxYix,y)Pr{3x^x: e{x, R) = eix, R), {x,y) (£ As{Pxy)} (62) 

x,y 

= Y^PxY{x,y) PT{e{x,R) = e{x,R)} (63) 

x,y x^x,{x,y)<^As[PxY) 

<Y,PxY{x,y)2-'\As{Px\Y=y)\ (64) 

< 2~n..JPxY)-SLjPY)-i^ (65) 

where a follows from the property of two-universal hash functions and b follows from Lemma |3] Hence, 
Pr{£^i} < ei if ^ = E^^^{Pxy) — ^min(^^) ~ logei. Hence, we have demonstrated a protocol that 
achieves the given error bound. 

B. Proof of lower bounds in Theorem |3] 

Let {ex, ey, R) G A^(A' x y ^ x Cy). Then there must exist a realization R = r such that the eiTor 
bound in (fT4l) is met. We first prove (|27] ). 



ei.,^ciX) = Ho[ex{X,r)] (66) 

>Ho[ex{X,r)\Y] (67) 

= Ho[ep,{X,r),ey{Y,r)\Y] (68) 

> Ho{gx [ex{X,r),ey{Y,r),r] \Y} (69) 
= Ho[X{r)\Y] (70) 

> m{X\Y), (71) 






{x, y) pairs 



FIG. 1 : The bining used in the Slepian-Wolf in Ref. 11 1811 is used here as well 



where a follows from the definition of ^d-cnc("'^)' ^ follows since conditioning reduces Hq, c is an identity 
that is easily derived from the definition of Hq, d follows since taking a function reduces Hq, and e follows 
since Pr{X(r) / X} < e and from 

The proof for ( |28] ) is similar and is omitted. We now prove 



4-enc(^) +4-enc(n = H^[ex{X,T)] + H^[ey{Y,T)] (72) 

>H^[ex{X,r),ey{Y,r)] (73) 

>Ho{g[ex{X,r),ey{Y,r),r]} (74) 

= H^[X{r),Y{r)] (75) 

>HI,{X,Y), (76) 



where a follows from the sub-additivity of the Renyi entropy. 



C. Proof of achievability in Theorem|3] 

We show the existence of a protocol for distributed encoding (again based on two-universal hash functions) 
and is given by the following steps. 

1. Let ex : X y< TZ ^ Cx, ey '■ 3^ x 7^ — > be two-universal hash functions and let Cx = 
{1, 2, • • • , 2^-*} and C;y = {1, 2, • • • , 2^^^}. Alice takes x e X, generates R (known both to Bob 
and Charlie), and sends i = ex{x, R) to Charlie. Similarly, Bob takes y £ y and sends j = ey{y, R) 
to Charlie. See Fig. [Ufor an illustration of the encoding. 
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2. Charlie passes the received indices to the decoder g : Cx ^ Cy x TZ ^ x y that outputs 
{x,y) = {x,y) if there is only one pair {x,y) such that ex{x,R) = i, ey{y,R) = j and {x,y) G 
■As{Pxy)- In all other cases, it declares an enm 

Let So, 81,62, £3 € R'^ and Ylk=o ^ £■ The probability of error of the above protocol is computed by 
defining the following events. 



Eq 

El 
E12 



{{X,Y)^As{Pxy)}, (77) 

{3x^X: ex{±,R) = ex{X,R), {x,Y) e AsiPxv)}. (78) 

{3 y / y : ey{y, R) = ey{Y, R), {X, y) G As{Pxy)}- (79) 
{3{x,y) : {x,y) + {X,Y),ex{x,R) = ex{X, R), ey{y, R) = ey{Y,R), 

ix,y)eAs{PxY)}. (80) 



The probability of error is given by the probability of the union of these events and we upper bound that by 
the union bound as 



Pe = Pr {£^0 UE1UE2U E12} 

< Pt{Eo} + Pt{Ei} + Fr{E2} + Prj^ia}. 

For any eo > 0, we could choose a.5 > such that Pr{£^o} < Co- We now bound Prjii^i} as follows. 
Pr{£;i} = Pr{3 x ^ X : ex{£,R) = ex{X,R),{x,Y) G As{Pxy)} 

= y^^PxY{x,y)Pr{3 f / X : ex{x,R) = ex{x,R), {x,y) G AsiPxY)} 



x,y 



J2PxY{x,y) Yl Pi{ex{d:,R) = ex{x,R)} 

xj^x,{x,y)eAs{PxY) 



<Y,PxY{x,y)2-'^\AsiPx\Y=y)\ 



(81) 
(82) 

(83) 
(84) 

(85) 
(86) 
(87) 



where a follows from the property of two-universal hash function and b follows from Lemma |3] Hence, 
Pr{Si} < El, if Ix > HLx(^xy) - ^LniPv) - logei- Similarly, we could show that Prj^a} < £2, if 



ey> 



XY) 



:;5 

^min 



(Px) - log £2 and Pr{£i2} < £3, if ^A- + iy > H^ax(^xy) - log^s- 



D. Proofs of Lemmas [D and |2] 

The proofs of Lemmas [T] and |2] follow straightforwardly if we could invoke Lemma|5] which we can if we 
can show that 6 is not zero for large enough n. It is here that we shall need the following remarkable result by 
Holenstein and Renner jlQI giving explicit bounds. 



Theorem 4. (Holenstein and Renner nidi ) Let Py^^^Y^^ := PxiYi ■ ■ ■ Px^Y^ ^ probability distribution over 
^ yn^ Then, for any 5 G [0, log \XW and x, y chosen according to Px^'Y^ 



Pr 



log(Pxr|Y?(x,y)) >^(X^TO + n5 



< e 



(88) 
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and, similarly 



Pr 



< e (89) 



where e = 2 2ios^(\x\+3) _ 

Let us now assume that we want to ensure that for S = Eq, 

Ft{X^ ^ AsiPj^n)} < eo. (90) 
Recall that Xi, X2, ... are i.i.d. and distributed according to Px- Then it is sufficient to ensure that 

Pr [-log(Pxn(x)) > 7iH{X,) + n6\og\X\] < ^, (91) 
Pr[-log(Px?(x)) <nF(Xi)-n51og|;f|] < ^, (92) 

where we have taken out the term inside | • | to get upper bounds to the probabilities. Now invoking the result 



by Holenstein and Renner 11611 . if we choose 5 = Eq, then for all n > no(eo)' where 



21og(ei,/2) VdA'l+S) 



the eiTor bound in (|90l ) is met. Note that we could choose 5 = for n < ?io(eo). Hence, both the sequences 
{Hi^{X^)/n} and {H!_^^{X]')/n} are equal V n > no(eo)- Hence, 

lim lim = lim lim = lim lim . (94) 

e— >-0n— >oo n e— 5-On— 5>oo 77, eq— >-0"— ^-oo n 

Now Lemma[5]can be invoked to yield the desired answer. It is straightforward to extend the above argument 
for the i.i.d. sequence of a pair of random variables {X, Y). 

VI. CONCLUSIONS AND ACKNOWLEDGEMENT 

In conclusion, we have given the one-shot bounds for the Slepian-Wolf protocol for distributed encoding of 
correlated sources ifisl]. We constructed a protocol for distributed encoding using two-universal hash functions 
and this gave the achievability region for the rate-pairs. We show that the bounds are asymptotically tight and 
yield the same rate region as the Slepian-Wolf. Our protocol is based on defining a set based on Smooth Renyi 
entropies reminiscent of the typical set in the asymptotic case. The authors are not aware of any pre-existing 
one-shot results for the multi-party scenario for the classical case. 

The authors wish to thank R. Renner for giving his helpful comments on the subject. 
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